Using Markov Chains to Reduce Randomness
نویسنده
چکیده
1 Useful Linear Algebra Let v = (v1, v2, . . . , vn) be a non-zero n-dimensional row vector and P an n× n matrix. • We say v is an eigenvector of P with corresponding eigenvalue λ iff vP = λv. • The L1-norm of v (denoted ‖v‖1) is ∑n i=1 vi. • The L2-norm of v (denoted ‖v‖2) is √∑n i=1 v 2 i . • The inner product of two vectors v and w (denoted v ·w) is ∑n i=1 viwi. • We say vectors v,v, . . .v are orthonormal iff v · v = { 1 if i = j 0 if i 6= j Suppose P is an n × n matrix with positive entries, eigenvectors v,v, . . . ,v, and eigenvalues λ1, λ2, . . . , λn. Let α ∈ R. Using the above definitions we derive the following facts: Fact 1 αP has eigenvectors v,v, . . . ,v and eigenvalues αλ1, αλ2, . . . , αλn Proof v(αP ) = α(vP ) = αλiv . Fact 2 P + I has eigenvectors v,v, . . . ,v and eigenvalues λ1 + 1, λ2 + 1, . . . , λn + 1 Proof v(P + I) = vP + vI = λiv (i) + v = (λi + 1)v .
منابع مشابه
Empirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملQuantum Simulation of Markov Chains
The possibility of simulating a stochastic process by the intrinsic randomness of quantum system is investigated. Two simulations of Markov Chains by the measurements of quantum systems are proposed.
متن کاملThe Rate of Rényi Entropy for Irreducible Markov Chains
In this paper, we obtain the Rényi entropy rate for irreducible-aperiodic Markov chains with countable state space, using the theory of countable nonnegative matrices. We also obtain the bound for the rate of Rényi entropy of an irreducible Markov chain. Finally, we show that the bound for the Rényi entropy rate is the Shannon entropy rate.
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملThe Randomness Recycler Approach to Perfect Sampling
1. The Randomness Recycler versus Markov chains At the heart of the Monte Carlo approach is the ability to sample from distributions that are in general very difficult to describe completely. For instance, the distribution might have an unknown normalizing constant which might require exponential time to compute. In these situations, in lieu of an exact approach, Markov chains are often employe...
متن کاملCluster-Based Image Segmentation Using Fuzzy Markov Random Field
Image segmentation is an important task in image processing and computer vision which attract many researchers attention. There are a couple of information sets pixels in an image: statistical and structural information which refer to the feature value of pixel data and local correlation of pixel data, respectively. Markov random field (MRF) is a tool for modeling statistical and structural inf...
متن کامل